Skip to content

GH-607: Specify handling for unrecognized logical types - #606

Merged
Fokko merged 3 commits into
apache:masterfrom
divjotarora:log-phys-type-combo
Sep 3, 2026
Merged

GH-607: Specify handling for unrecognized logical types#606
Fokko merged 3 commits into
apache:masterfrom
divjotarora:log-phys-type-combo

Conversation

@divjotarora

@divjotarora divjotarora commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

Rationale for this change

We currently do not specify how readers should handle unrecognized logical types or logical/physical type combinations.

What changes are included in this PR?

Specify that unrecognized logical types or logical/physical type combinations should result in both the logical type annotation and stats being ignored.

Do these changes have PoC implementations?

parquet-java reference implementation

@divjotarora divjotarora changed the title GH-3710: Specify handling for unrecognized logical types GH-607: Specify handling for unrecognized logical types Aug 6, 2026

@emkornfield emkornfield left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for officially documenting this.

@etseidl etseidl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch.

@alamb alamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense to me -- thank you @divjotarora

It may also make sense to put a note / link to this section from the main contributing guide where this is explicitly mentioned:

version of the format. New logical types are considered forward

@divjotarora

Copy link
Copy Markdown
Contributor Author

It may also make sense to put a note / link to this section from the main contributing guide where this is explicitly mentioned:

Nice catch @alamb, updated!

Comment thread LogicalTypes.md Outdated
@Fokko Fokko added this to the 2.14.0 milestone Sep 3, 2026
@Fokko

Fokko commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Vote passed, moving this forward: https://lists.apache.org/thread/f1qgt2x0gg8ybwgcgshc67k1hso5t2qd

Thanks @divjotarora and everyone who participated 👍

@Fokko
Fokko merged commit 78b7aac into apache:master Sep 3, 2026
@divjotarora
divjotarora deleted the log-phys-type-combo branch September 3, 2026 18:22
@alamb

alamb commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

🙏 Thanks @divjotarora and @Fokko

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Specify handling for unrecognized logical/physical type combinations